Multi-camera system, camera, processing method of camera, confirmation apparatus, and processing method of confirmation apparatus

ABSTRACT

A multi-camera system, including a first camera apparatus, a second camera apparatus, and an information processing apparatus. The information processing apparatus includes a communication interface and processing circuitry. The processing circuitry is configured to receive a predetermined user input and in response to the predetermined user input, send, via the communication interface, a first control signal to the first camera apparatus that captures a first video, and send, via the communication interface, a second control signal to the second camera apparatus that captures a second video. The first control signal causes the first camera apparatus to assign first unique identifiers to frames of the first video captured by the first camera apparatus. The second control signal causes the second camera apparatus to assign second unique identifiers to frames of the second video captured by the second camera apparatus.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of and claims priority toU.S. application Ser. No. 16/322,143, filed Jan. 31, 2019, which claimsthe benefit of PCT Application No. PCT/JP2017/028096, filed Aug. 2,2017, which claims the benefit of Japanese Priority Patent ApplicationJP 2016-156717, filed Aug. 9, 2016. The benefit of priority is claimedto each of the foregoing, and the entire contents of U.S. applicationSer. No. 16/322,143 and Japanese Priority Patent Application JP2016-156717 are incorporated herein by reference.

TECHNICAL FIELD

The present technology relates to a multi-camera system, a camera, aprocessing method of the camera, a confirmation apparatus, and aprocessing method of the confirmation apparatus.

BACKGROUND ART

In the related art, moving images of an object are captured by camerasat a plurality of angles in order to confirm movements of the object,for example, doing sports practice. A user wants to confirm the movingimages immediately after that. In the past, the captured moving imagesare reproduced by the cameras, respectively. Alternatively, the capturedmoving images are imported into a device such as a personal computer,and the respective files of the captured moving images are reproduced bythe device. To confirm a form of the object at a certain moment, a userwants to pause the moving image, switch the moving image to a movingimage taken at a different angle in a short time without stress, andwatch the moving image after switching. However, there is no measure todo so.

For example, PTL 1 discloses that a summary content is automaticallygenerated from a plurality of contents for a user to confirm thecontents in a short time. According to this disclosure, the summarycontent is generated by changing a reproducing speed of each contentdepending on amounts of generated events predefined. However, it is notpossible to reproduce the captured contents of an arbitrarily specifiedtime and at an arbitrarily specified angle immediately after capturingthe contents.

CITATION LIST Patent Literature

-   [PTL 1]-   Japanese Patent Application Laid-open No. 2010-039877

SUMMARY Technical Problem

It is desirable to confirm well images captured by a plurality ofcameras.

Solution to Problem

In one embodiment of the present disclosure, there is provided amulti-camera system, including a first camera apparatus, a second cameraapparatus, and an information processing apparatus. The informationprocessing apparatus including a communication interface and processingcircuitry. The processing circuitry being configured to receive apredetermined user input and in response to the predetermined userinput, send, via the communication interface, a first control signal tothe first camera apparatus that captures a first video, and send, viathe communication interface, a second control signal to the secondcamera apparatus that captures a second video. The first control signalcauses the first camera apparatus to assign first unique identifiers toframes of the first video captured by the first camera apparatus. Thesecond control signal causes the second camera apparatus to assignsecond unique identifiers to frames of the second video captured by thesecond camera apparatus. Each of the first unique identifiers assignedto the frames of the first video is associated with a different one ofthe second unique identifiers assigned to the frames of the secondvideo.

In one embodiment, there is provided an information processingapparatus, including a communication interface and processing circuitry.The processing circuitry is configured to receive a predetermined userinput and in response to the predetermined user input, send, via thecommunication interface, a first control signal to a first cameraapparatus that captures a first video, and send, via the communicationinterface, a second control signal to a second camera apparatus thatcaptures a second video. The first control signal causes the firstcamera apparatus to assign first unique identifiers to frames of thefirst video captured by the first camera apparatus. The second controlsignal causes the second camera apparatus to assign second uniqueidentifiers to frames of the second video captured by the second cameraapparatus. Each of the first unique identifiers assigned to the framesof the first video is associated with a different one of the secondunique identifiers assigned to the frames of the second video.

In one embodiment, there is provided an information processingapparatus, including a communication interface and processing circuitry.The processing circuitry is configured to transmit, via thecommunication interface, a first unique identifier of a frame of a firstvideo to a first camera apparatus, which captured the first video andreceive at least one frame of the first video including the framecorresponding to the first unique identifier from the first cameraapparatus in response to the transmitted first unique identifier. Eachof the at least one frame of the first video corresponding to adifferent one of a plurality of first unique identifiers. The processingcircuitry is configured to output one or more of the at least one videoframe of the first video for display to a user, receive a predetermineduser input during the output of the one or more of the at least onevideo frame of the first video for display to the user, and in responseto the received predetermined user input, transmit, via thecommunication interface, a second unique identifier of a frame of asecond video to a second camera apparatus, which captured the secondvideo, the second unique identifier being associated with the firstunique identifier of one of the at least one frame of the first video,receive at least one frame of the second video including the framecorresponding to the second unique identifier from the second cameraapparatus in response to the transmitted second unique identifier, eachof the at least one frame of the second video corresponding to adifferent one of a plurality of second unique identifiers, and outputone or more of the at least one video frame of the second video fordisplay to the user.

In one embodiment, there is provided a non-transitory computer-readablemedium storing instructions which when executed by a computer cause thecomputer to perform a method of controlling cameras to assign uniqueidentifiers to frames of captured video, the method including receivinga predetermined user input; and in response to the predetermined userinput, send, via a communication interface, a first control signal to afirst camera apparatus that captures a first video, and send, via thecommunication interface, a second control signal to a second cameraapparatus that captures a second video. The first control signal causesthe first camera apparatus to assign first unique identifiers to framesof the first video captured by the first camera apparatus. The secondcontrol signal causes the second camera apparatus to assign secondunique identifiers to frames of the second video captured by the secondcamera apparatus. Each of the first unique identifiers assigned to theframes of the first video is associated with a different one of thesecond unique identifiers assigned to the frames of the second video.

In one embodiment, there is provided a non-transitory computer-readablemedium storing instructions which when executed by a computer cause thecomputer to perform a method of playing back video recorded by aplurality of cameras, the method including transmitting, via acommunication interface, a first unique identifier of a frame of a firstvideo to a first camera apparatus, which captured the first video;receiving at least one frame of the first video including the framecorresponding to the first unique identifier from the first cameraapparatus in response to the transmitted first unique identifier, eachof the at least one frame of the first video corresponding to adifferent one of a plurality of first unique identifiers; outputting oneor more of the at least one video frame of the first video for displayto a user; receiving a user input during the output of the one or moreof the at least one video frame of the first video for display to theuser; and in response to the received user input, transmitting, via thecommunication interface, a second unique identifier of a frame of asecond video to a second camera apparatus, which captured the secondvideo, the second unique identifier being associated with the firstunique identifier of one of the at least one frame of the first video,receiving at least one frame of the second video including the framecorresponding to the second unique identifier from the second cameraapparatus in response to the transmitted second unique identifier, eachof the at least one frame of the second video corresponding to adifferent one of a plurality of second unique identifiers, andoutputting one or more of the at least one video frame of the secondvideo for display to the user.

Advantageous Effects

According to the present technology, the user can confirm well theimages captured by the plurality of cameras on the confirmationapparatus. It should be noted that the effects described in the presentspecification are merely illustrative and are not limitative, and mayhave additive effects.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram showing a configuration example of amulti-camera system according to an embodiment of the presenttechnology.

FIG. 2 is a diagram showing an installation status of the cameras.

FIG. 3 is a block diagram showing a configuration example of the camera.

FIG. 4 is a block diagram showing a configuration example of theconfirmation apparatus.

FIG. 5 is a diagram showing an example of timing charts when each cameraassigns frame numbers to frames in the frame buffer.

FIG. 6 is a diagram showing an example of a screen for reproducing animage (moving image content) captured by multiple cameras and displayedon a panel of the confirmation apparatus.

FIG. 7 is a diagram showing a communication sequence example between theconfirmation apparatus and each camera at the time of the reproduction.

FIG. 8 is a diagram showing an example of an operation, in whichcontent-to-be-reproduced is downloaded from each camera to the framebuffer of the confirmation apparatus in advance.

FIG. 9 is a diagram showing another example of an operation, in whichcontent-to-be-reproduced is downloaded from each camera to the framebuffer of the confirmation apparatus in advance.

FIG. 10 is a block diagram showing another configuration example of themulti-camera system.

FIG. 11 is a block diagram showing another configuration example of themulti-camera system.

FIG. 12 is a block diagram showing another configuration example of themulti-camera system.

FIG. 13 is a view schematically depicting a general configuration of asurgery room system.

FIG. 14 is a view depicting an example of display of an operation screenimage of a centralized operation panel.

FIG. 15 is a view illustrating an example of a state of surgery to whichthe surgery room system is applied.

FIG. 16 is a block diagram depicting an example of a functionalconfiguration of a camera head and a camera control unit (CCU) depictedin FIG. 15.

DESCRIPTION OF EMBODIMENTS

Hereinafter, a mode (hereinafter referred to as embodiment) for carryingout the present technology will be described. The embodiment of thepresent technology will be described in the following order.

1. Embodiment

2. Modification Examples

3. Application

1. Embodiment

[Configuration Example of Multi-Camera System]

FIG. 1 shows a configuration example of a multi-camera system 10Aaccording to an embodiment. The multi-camera system 10A includes aplurality of, here, three cameras (video cameras), i.e., a camera(camera A) 101-A, a camera (camera B) 101-B, and a camera (camera C)101-C. In addition, the multi-camera system 10A includes a confirmationapparatus 102, which is a mobile terminal such as a smartphone and atablet, a personal computer, or the like.

The cameras 101-A, 101-B, and 101-C and the confirmation apparatus 102are connected via a wired or wireless LAN. For example, the confirmationapparatus 102 functions as a master device, and the cameras 101-A,101-B, and 101-C each functions as a slave device. FIG. 2 shows aninstallation status of the cameras 101-A, 101-B, and 101-C. The cameras101-A, 101-B, and 101-C are arranged to capture the same object OB atdifferent angles.

The confirmation apparatus 102 causes (triggers) each camera to startand stop capturing an image in response to a user's operation. In thiscase, the confirmation apparatus 102, i.e., the master device, issues atrigger signal (command) to start or stop capturing an image to eachcamera. Each camera receives the trigger signal via a control interface(control I/F), which is configured to perform communication, andoperates in response to the instruction. Note that the control interfaceof each camera is built in the camera. In addition, the confirmationapparatus 102 includes a panel (display). After capturing an image, auser can check the image captured by each camera on the display.

The cameras 101-A, 101-B, and 101-C each includes an imager and a memorythat writes image data of each frame obtained by capturing an image bythe imager. In this case, the image data of each frame (frame rate of 60Hz, for example) is intraframe-compressed, i.e., compressed in JPEGformat in this embodiment, and the compressed data is written into thememory. In addition, the image data of each frame is loop-recorded inthe memory for at least predetermined time or longer, i.e., threeseconds or longer in this embodiment. It should be noted that the imagedata of each frame may not necessarily be loop-recorded. Alternatively,the image data of each frame may be encoded, e.g., Advanced Video Coded(AVC), and the encoded data may be written into the memory.

When each of the cameras 101-A, 101-B, and 101-C receives an end triggersignal from the confirmation apparatus 102, each of the cameras 101-A,101-B, and 101-C assigns frame numbers to frames within a predeterminedpast time period, i.e., three seconds in this embodiment, starting fromthe frame corresponding to the end trigger signal. For example, thefirst frame number is “1”, and the last frame number is “180”. When eachof the cameras 101-A, 101-B, and 101-C receives a transfer requestincluding a frame number from the confirmation apparatus 102, each ofthe cameras 101-A, 101-B, and 101-C reads the image data of the framehaving the specified frame number from the memory, and transfers theimage data to the confirmation apparatus 102.

The confirmation apparatus 102 sends the end trigger signal to eachcamera in response to a user's operation to stop capturing an image. Inaddition, the confirmation apparatus 102 sends the transfer requestincluding the frame number to a predetermined camera selected from thecameras 101-A, 101-B, and 101-C in response to the user's operation.Then, the confirmation apparatus 102 receives the image data of theframe having the specified frame number transferred from thepredetermined camera, and displays an image of the image data on thepanel (display).

[Configuration Example of Camera]

FIG. 3 shows a configuration example of the camera 101 (101-A, 101-B,and 101-C). The camera 101 includes a CPU 111, a memory 112, animager/lens 113, a camera signal processing unit 114, and a codecprocessing unit 115. Further, the camera 101 includes a panel processingunit 116, a panel 117, a wired communication processing unit 118, awired LAN terminal 119, a wireless communication processing unit 120,and an antenna 121.

The CPU 111 controls operation of components of the camera 101. Thememory 112 stores control software and data, and constitutes a work areaof the CPU 111 and the like. In addition, the memory 112 constitutes theframe buffer that loop-records the captured image data.

The imager/lens 113 includes an image capture lens and an imager,captures an image of an object, and obtains an image capture signal. Thecamera signal processing unit 114 processes the image capture signalobtained by the imager/lens 113, and generates image data (capturedimage data) corresponding to the object. The codec processing unit 115JPEG-compresses the image data of each frame obtained by the camerasignal processing unit 114. Thus, the image data of each frameJPEG-compressed is loop-recorded in the frame buffer of the memory 112.

The panel processing unit 116 drives a panel 117 on the basis of theimage data obtained by the camera signal processing unit 114, anddisplays a captured image on the panel 117. The panel 117 includes anLCD, an organic EL panel, or the like. The panel 117 has a touch panelfunction. As necessary, user interfaces (UIs) are also displayed on thepanel 117 for user's operation.

The wired communication processing unit 118 communicates via wire withan external device, i.e., the confirmation apparatus 102 in thisembodiment, via a wired LAN terminal 119. The wireless communicationprocessing unit 120 communicates wirelessly with the external device,i.e., the confirmation apparatus 102 in this embodiment, via an antenna121. Note that either the wireless communication or the wiredcommunication is selected.

[Configuration Example of Confirmation Apparatus]

FIG. 4 shows a configuration example of the confirmation apparatus 102.The confirmation apparatus 102 includes a CPU 131, a memory 132, a codecprocessing unit 133, and a graphic processing unit 134.

In addition, the confirmation apparatus 102 includes a panel processingunit 135, a panel 136, a wired communication processing unit 137, awired LAN terminal 138, a wireless communication processing unit, and anantenna 140.

The CPU 131 controls operation of components of the confirmationapparatus 102.

The memory 132 stores control software and data, and constitutes a workarea of the CPU 131 and the like. In addition, the memory 132temporarily records the image data of each frame transferred from thecamera 101 (see FIG. 3).

The codec processing unit 133 reads the image data of each frametemporarily recorded in the frame buffer of the memory 132, anddecompresses the image data for displaying the image. The panelprocessing unit 135 drives the panel 136 on the basis of the image datadecompressed by the codec processing unit 133, and displays the image onthe panel 136. The panel 136 includes an LCD, an organic EL panel, orthe like. The panel 136 has a touch panel function. As necessary, UIsare also displayed on the panel 136 for user's operation.

The wired communication processing unit 137 communicates via wire withan external device, i.e., the camera 101 in this embodiment, via a wiredLAN terminal 138. The wireless communication processing unit 139communicates wirelessly with the external device, i.e., the camera 101in this embodiment, via an antenna 140. Note that either the wirelesscommunication or the wired communication is selected.

[Example of Assigning Frame Numbers by End Trigger]

FIG. 5 shows an example of timing charts when each camera assigns theframe numbers to the frames in the frame buffer where the end triggersignal is sent from the confirmation apparatus 102 to each camera. Atthe time t1, the confirmation apparatus 102 sends the end trigger signalto each camera. Each camera stops a recording operation on the frame atthe time t1 (an image-capturing operation is not necessarily stopped,but may be stopped), and the frame number “1” is assigned to the frame.Then, each camera assigns frame numbers to the respective framesrecorded in the frame buffer in the descending order starting from theframe having the frame number “1” backward in time series.

In the example shown in FIG. 5, frame numbers are assigned to the framesof a moving image for three seconds starting from the end trigger, andtherefore each front frame has the frame number “180”. In this manner,the frames having the same frame number of the respective cameras areconsidered to be at the same time point. The respective cameras may notnecessarily have the same exposure phase, for example, using a generatorlock (Genlock). In addition, timing differences are permissible when theend trigger signal reaches the respective cameras from the confirmationapparatus 102. However, if the respective cameras have the same exposurephase and the same trigger timing, an image taken by one camera can besmoothly switched to an image taken by the other camera when reproducingthe image.

[Example of User Interfaces on Confirmation Apparatus]

FIG. 6 shows an example of a screen for reproducing images (moving imagecontent) captured by the multiple cameras and displayed on the panel 136of the confirmation apparatus 102. In this example, the camera (cameraA) 101-A is selected, and an image 300 captured by the camera (camera A)101-A is displayed. An UI screen is superimposed on the captured imageof the screen for the user's operation.

A user operates a play operation part 301, in which play icons aredisplayed. As a result, the image captured by the selected camera on thescreen can be operated normally including reproduction, pause, fastforward, rewind, frame-by-frame advance, and the like. Here, a scrollbar is provided next to the play icons, which is scrolled with a fingerto perform frame-by-frame advance forward and backward, fast forward,and rewind.

The user operates a camera switching operation part 302, in which cameraswitching icons are displayed. As a result, it is possible to switch aframe at one camera angle to a frame at another camera angle at desiredreproduction time. In this example, when the button “B” is pressed, theimage captured by the camera (camera A) 101-A is switched to the imagecaptured by the camera (camera B) 101-B at the same time point, i.e., atthe moment when the button is pressed. Similarly, when the button “C” ispressed, the image captured by the camera (camera A) 101-A is switchedto the image captured by the camera (camera C) 101-C at the same timepoint, i.e., at the moment when the button is pressed.

Note that the cameras can be switched not only by pressing the buttons,but also by scrolling the scroll bar above the buttons from left toright or vice versa. In a case where a larger number of cameras areused, it is possible to reproduce images like time-slice representation.The cameras can be switched during the reproduction or during the pause.

[Communication Sequence Between Confirmation Apparatus and Each Camera]

FIG. 7 is a diagram showing a communication sequence example between theconfirmation apparatus 102 and each camera at the time of thereproduction. First, FIG. 7 shows a communication example that theimages captured by the camera (camera A) 101-A are displayed byframe-by-frame advance.

As the frame number of the front frame is “180 (#180)”, the confirmationapparatus 102 requests the camera (camera A) 101-A to transfer the imagedata of the #180 frame (in this case, compressed and coded in JPEGformat). In response, the camera (camera A) 101-A reads the image dataof the #180 frame in the frame buffer of the camera (camera A) 101-A,and transfers the image data to the confirmation apparatus 102. As aresult, the image of the image data of the #180 frame is displayed onthe panel 136 of the confirmation apparatus 102.

Next, the confirmation apparatus 102 similarly requests the camera(camera A) 101-A to transfer the image data of the #179 frame. Inresponse, the camera (camera A) 101-A reads the image data of the #179frame in the frame buffer of the camera (camera A) 101-A, and transfersthe image data to the confirmation apparatus 102. As a result, the imageof the image data of the #179 frame is displayed on the panel 136 of theconfirmation apparatus 102.

Next, the confirmation apparatus 102 switches the camera (camera A)101-A to the (camera B) 101-B. For example, this corresponds to theoperation when the button “B” of the camera switching operation part 302on the UI screen of FIG. 6 is pressed. In this case, the confirmationapparatus 102 requests the camera (camera B) 101-B to transfer the imagedata of the #179 frame. As a result, the image of the image data of the#179 frame is displayed on the panel 136 of the confirmation apparatus102. The similar operation will be repeated thereafter.

[Example of Improvement in Display Latency]

In the above-described example, the confirmation apparatus 102 acquiresimage data of a predetermined frame from a predetermined camera thattook the image every time the confirmation apparatus 102 displays theimage of the predetermined frame taken by the predetermined camera. Inthis case, it is undesirably expected to prolong display latencydepending on the status of a communication path, in particular where theconfirmation apparatus 102 is connected to each camera via the wirelessLAN.

In order to improve the display latency, it is conceivable that thememory132 of the confirmation apparatus 102 (see FIG. 4) includes theframe buffer, and the content-to-be-reproduced of each camera isdownloaded to the frame buffer in advance.

In this embodiment, the JPEG files for three seconds of all the camerasare buffered in the confirmation apparatus 102 in advance. After thebuffering, the confirmation apparatus 102 reproduces the images withoutcommunication, i.e., closed, and unaffected by the status of acommunication path. As a result, the display latency is improved.

FIG. 8 is a timing chart showing an example of an operation, in whichcontent-to-be-reproduced is downloaded from each camera to the framebuffer of the confirmation apparatus 102 in advance. Immediately afterthe confirmation apparatus 102 supplies the end trigger signal to eachcamera and each camera stops recording, the confirmation apparatus 102starts acquiring the image data of the predetermined frames from thepredetermined camera and displaying, i.e., reproducing, the image.Concurrently, each camera transfers JPEG files (=Motion JPRG/MPEG) forthree seconds to the confirmation apparatus 102 in background.

After each camera finishes transferring the files, the confirmationapparatus 102 does not communicate with each camera but acquires theimage data of the predetermined frames in the frame buffer of theconfirmation apparatus 102, and thereby displays the image of thepredetermined frames taken by the predetermined camera. In this manner,the display latency is improved unaffected by the status of acommunication path.

FIG. 9 is a timing chart showing another example of an operation, inwhich content-to-be-reproduced is downloaded from each camera to theframe buffer of the confirmation apparatus 102 in advance. In thisexample, the image data transferred from the camera to the confirmationapparatus 102 in background is not the data compressed in the JPEGformat, but main stream data encoded by the AVC or the like. In thiscase, the confirmation apparatus 102 may further encode the data intothe data in the JPEG format or the like for a frame unit after thetransfer.

As described above, in the multi-camera system 10A shown in FIG. 1, theconfirmation apparatus 102 sends the end trigger signal to each of thecameras 101-A, 101-B, and 101-C, each of the cameras 101-A, 101-B, and101-C assigns the frame numbers to the frames within a predeterminedpast time period starting from the frame corresponding to the timing atwhich each camera receives the end trigger signal, the confirmationapparatus 102 sends the transfer request including the frame numbers toeach of the cameras 101-A, 101-B, and 101-C, and the confirmationapparatus 102 displays the image of the image data sent from thepredetermined camera. Thus, the user can confirm well the image capturedby each camera on the confirmation apparatus 102. In this case, the sameframe number is assigned to the frames at the same time point taken bythe respective cameras. As a result, it is possible to easily switch aframe at one camera angle at a time point to a frame at another cameraangle at the same time point.

2. Modification Examples

In the above-described embodiment, the image data of the images capturedby the cameras 101-A, 101-B, and 101-C has a frame rate of 60 Hz. Thepresent technology is also applicable to the case that the image data ofthe images captured by the cameras 101-A, 101-B, and 101-C has anotherframe rate, e.g., a high frame rate of 240 Hz as shown in FIG. 5.

In the above-described embodiment, the numbers of the cameras are three.The present technology is also applicable to the case that the number ofthe cameras is two, four, or more than four.

In the above-described embodiment, each camera includes the controlinterface. Alternatively, it is conceivable that the camera may notinclude the control interface, and an external control device may beprovided for each camera.

FIG. 10 shows a configuration example of the multi-camera system 10B ofthat case. The components of FIG. 10 corresponding to those of FIG. 1are denoted by the same reference signs. Each of the cameras 101-A,101-B, and 101-C includes no control interface (control I/F) unlikethose of the multi-camera system 10A shown in FIG. 1. The cameras 101-A,101-B, and 101-C include an external control device (control device A)101-A, an external control device (control device B) 101-B, an externalcontrol device (control device C) 101-C having the similar functions asthe control interface (control I/F), respectively.

In the above-described embodiment, the confirmation apparatus 102independent of the cameras 101-A, 101-B, and 101-C is provided.Alternatively, it is conceivable that no confirmation apparatus 102 maybe provided, and any of the cameras 101-A, 101-B, and 101-C may alsofunction as the confirmation apparatus.

FIG. 11 shows a configuration example of a multi-camera system 10C ofthat case. The components of FIG. 11 corresponding to those of FIG. 1are denoted by the same reference signs.

Note that the multi-camera system 10C shown in FIG. 11 corresponds tothe multi-camera system 10A shown in FIG. 1. The same applies to themulti-camera system 10B shown in FIG. 10. FIG. 12 shows a configurationexample of the multi-camera system 10D corresponding to the multi-camerasystem 10B shown in FIG. 10, detailed description of which is omitted.

3. Application

The technology according to an embodiment of the present disclosure canbe applied to various products. For example, the multi-camera system,camera, processing method of the camera, confirmation apparatus, and/orprocessing method of the confirmation apparatus according to certainembodiments of the present disclosure may be applied to a surgery roomsystem.

In one embodiment, application of the present technology to the medicalfield, such as a surgery room system, allows an operator (e.g., asurgeon) to mark events during a medical procedure (e.g., a surgery) forsubsequent review. The marked events allow the operator or any otherperson to later switch between video recorded by multiple cameras duringplayback.

For example, the multi-camera system 10A when incorporated in a surgeryroom system may include a ceiling camera 5187, and surgery field camera5189, and audiovisual controller 5107, as described below. The ceilingcamera 5187 corresponds to the camera 101-A, the surgery field camera5189 corresponds to the camera 101-B, and the confirmation apparatus 102is incorporated in the audiovisual controller 5107, according to oneembodiment. In other embodiments, the confirmation apparatus 102 isprovided as a separate device (e.g., a mobile terminal such as asmartphone and a tablet, a personal computer, or the like).

In one embodiment, the confirmation apparatus 102 sends an end triggersignal to each camera (e.g., the ceiling camera 5187 and surgery fieldcamera 5189) in response to a user's (e.g., operator or surgeon)operation to stop capturing an image. The confirmation apparatus 102 mayinclude or be coupled to a switch (e.g., a pedal or button) that isactuated by the operator as the user's operation. As described above,when each of a plurality of cameras (e.g., the ceiling camera 5187 andsurgery field camera 5189) receives the end trigger signal from theconfirmation apparatus 102, each of the cameras assigns frame numbers toframes within a predetermined past time period, i.e., three seconds inthis embodiment, starting from the frame corresponding to the endtrigger signal. For example, the first frame number is “1”, and the lastframe number is “180”. When each of the cameras receives a transferrequest including a frame number from the confirmation apparatus 102,each of the cameras reads the image data of the frame having thespecified frame number from the memory, and transfers the image data tothe confirmation apparatus 102, as similar to as described above.

FIG. 13 is a view schematically depicting a general configuration of asurgery room system 5100 to which the technology according to anembodiment of the present disclosure can be applied. Referring to FIG.13, the surgery room system 5100 is configured such that a group ofapparatus installed in a surgery room are connected for cooperation witheach other through an audiovisual (AV) controller 5107 and a surgeryroom controlling apparatus 5109.

In the surgery room, various apparatus may be installed. In FIG. 13, asan example, various apparatus group 5101 for endoscopic surgery, aceiling camera 5187, a surgery field camera 5189, a plurality of displayapparatus 5103A to 5103D, a recorder 5105, a patient bed 5183 and anillumination 5191 are depicted. The ceiling camera 5187 is provided onthe ceiling of a surgery room and images the hands of a surgeon. Thesurgery field camera 5189 is provided on the ceiling of the surgery roomand images a state of the entire surgery room.

Among the apparatus mentioned, the apparatus group 5101 belongs to anendoscopic surgery system 5113 hereinafter described and include anendoscope, a display apparatus which displays an image picked up by theendoscope and so forth. Various apparatus belonging to the endoscopicsurgery system 5113 are referred to also as medical equipment.Meanwhile, the display apparatus 5103A to 5103D, the recorder 5105, thepatient bed 5183 and the illumination 5191 are apparatus which areequipped, for example, in the surgery room separately from theendoscopic surgery system 5113. The apparatus which do not belong to theendoscopic surgery system 5113 are referred to also as non-medicalequipment. The audiovisual controller 5107 and/or the surgery roomcontrolling apparatus 5109 cooperatively control operation of themedical equipment and the non-medical equipment with each other.

The audiovisual controller 5107 integrally controls processes of themedical equipment and the non-medical equipment relating to imagedisplay. Specifically, each of the apparatus group 5101, the ceilingcamera 5187 and the surgery field camera 5189 from among the apparatusprovided in the surgery room system 5100 may be an apparatus having afunction of sending information to be displayed during surgery (suchinformation is hereinafter referred to as display information, and theapparatus mentioned is hereinafter referred to as apparatus of a sendingsource). Meanwhile, each of the display apparatus 5103A to 5103D may bean apparatus to which display information is outputted (the apparatus ishereinafter referred to also as apparatus of an output destination).Further, the recorder 5105 may be an apparatus which serves as both ofan apparatus of a sending source and an apparatus of an outputdestination. The audiovisual controller 5107 has a function ofcontrolling operation of an apparatus of a sending source and anapparatus of an output destination to acquire display information fromthe apparatus of a sending source and transmit the display informationto the apparatus of an output destination so as to be displayed orrecorded. It is to be noted that the display information includesvarious images picked up during surgery, various kinds of informationrelating to the surgery (for example, physical information of a patient,inspection results in the past or information regarding a surgicalprocedure) and so forth.

Specifically, to the audiovisual controller 5107, information relatingto an image of a surgical region in a body lumen of a patient imaged bythe endoscope may be transmitted as the display information from theapparatus group 5101. Further, from the ceiling camera 5187, informationrelating to an image of the hands of the surgeon picked up by theceiling camera 5187 may be transmitted as display information. Further,from the surgery field camera 5189, information relating to an imagepicked up by the surgery field camera 5189 and illustrating a state ofthe entire surgery room may be transmitted as display information. It isto be noted that, if a different apparatus having an image pickupfunction exists in the surgery room system 5100, then the audiovisualcontroller 5107 may acquire information relating to an image picked upby the different apparatus as display information also from thedifferent apparatus.

Alternatively, for example, in the recorder 5105, information relatingto such images as mentioned above picked up in the past is recorded bythe audiovisual controller 5107. The audiovisual controller 5107 canacquire, as display information, information relating to the imagespicked up in the past from the recorder 5105. It is to be noted thatalso various pieces of information relating to surgery may be recordedin advance in the recorder 5105.

The audiovisual controller 5107 controls at least one of the displayapparatus 5103A to 5103D, which are apparatus of an output destination,to display acquired display information (namely, images picked up duringsurgery or various pieces of information relating to the surgery). Inthe example depicted, the display apparatus 5103A is a display apparatusinstalled so as to be suspended from the ceiling of the surgery room;the display apparatus 5103B is a display apparatus installed on a wallface of the surgery room; the display apparatus 5103C is a displayapparatus installed on a desk in the surgery room; and the displayapparatus 5103D is a mobile apparatus (for example, a tablet personalcomputer (PC)) having a display function.

Further, though not depicted in FIG. 13, the surgery room system 5100may include an apparatus outside the surgery room. The apparatus outsidethe surgery room may be, for example, a server connected to a networkconstructed inside and outside the hospital, a PC used by medical staff,a projector installed in a meeting room of the hospital or the like.Where such an external apparatus is located outside the hospital, alsoit is possible for the audiovisual controller 5107 to cause displayinformation to be displayed on a display apparatus of a differenthospital through a teleconferencing system or the like to performtelemedicine.

The surgery room controlling apparatus 5109 integrally controlsprocesses other than processes relating to image display on thenon-medical equipment. For example, the surgery room controllingapparatus 5109 controls driving of the patient bed 5183, the ceilingcamera 5187, the surgery field camera 5189 and the illumination 5191.

In the surgery room system 5100, a centralized operation panel 5111 isprovided such that it is possible to issue an instruction regardingimage display to the audiovisual controller 5107 or issue an instructionregarding operation of the non-medical equipment to the surgery roomcontrolling apparatus 5109 through the centralized operation panel 5111.The centralized operation panel 5111 is configured by providing a touchpanel on a display face of a display apparatus.

FIG. 14 is a view depicting an example of display of an operation screenimage on the centralized operation panel 5111. In FIG. 14, as anexample, an operation screen image is depicted which corresponds to acase in which two display apparatus are provided as apparatus of anoutput destination in the surgery room system 5100. Referring to FIG.14, the operation screen image 5193 includes a sending source selectionregion 5195, a preview region 5197 and a control region 5201.

In the sending source selection region 5195, the sending sourceapparatus provided in the surgery room system 5100 and thumbnail screenimages representative of display information the sending sourceapparatus have are displayed in an associated manner with each other. Auser can select display information to be displayed on the displayapparatus from any of the sending source apparatus displayed in thesending source selection region 5195.

In the preview region 5197, a preview of screen images displayed on twodisplay apparatus (Monitor 1 and Monitor 2) which are apparatus of anoutput destination is displayed. In the example depicted, four imagesare displayed by picture in picture (PinP) display in regard to onedisplay apparatus. The four images correspond to display informationsent from the sending source apparatus selected in the sending sourceselection region 5195. One of the four images is displayed in acomparatively large size as a main image while the remaining threeimages are displayed in a comparatively small size as sub images. Theuser can exchange between the main image and the sub images by suitablyselecting one of the images from among the four images displayed in theregion. Further, a status displaying region 5199 is provided below theregion in which the four images are displayed, and a status relating tosurgery (for example, elapsed time of the surgery, physical informationof the patient and so forth) may be displayed suitably in the statusdisplaying region 5199.

A sending source operation region 5203 and an output destinationoperation region 5205 are provided in the control region 5201. In thesending source operation region 5203, a graphical user interface (GUI)part for performing an operation for an apparatus of a sending source isdisplayed. In the output destination operation region 5205, a GUI partfor performing an operation for an apparatus of an output destination isdisplayed. In the example depicted, GUI parts for performing variousoperations for a camera (panning, tilting and zooming) in an apparatusof a sending source having an image pickup function are provided in thesending source operation region 5203. The user can control operation ofthe camera of an apparatus of a sending source by suitably selecting anyof the GUI parts. It is to be noted that, though not depicted, where theapparatus of a sending source selected in the sending source selectionregion 5195 is a recorder (namely, where an image recorded in therecorder in the past is displayed in the preview region 5197), GUI partsfor performing such operations as reproduction of the image, stopping ofreproduction, rewinding, fast-feeding and so forth may be provided inthe sending source operation region 5203.

Further, in the output destination operation region 5205, GUI parts forperforming various operations for display on a display apparatus whichis an apparatus of an output destination (swap, flip, color adjustment,contrast adjustment and switching between two dimensional (2D) displayand three dimensional (3D) display) are provided. The user can operatethe display of the display apparatus by suitably selecting any of theGUI parts.

It is to be noted that the operation screen image to be displayed on thecentralized operation panel 5111 is not limited to the depicted example,and the user may be able to perform operation inputting to eachapparatus which can be controlled by the audiovisual controller 5107 andthe surgery room controlling apparatus 5109 provided in the surgery roomsystem 5100 through the centralized operation panel 5111.

FIG. 15 is a view illustrating an example of a state of surgery to whichthe surgery room system described above is applied. The ceiling camera5187 and the surgery field camera 5189 are provided on the ceiling ofthe surgery room such that it can image the hands of a surgeon (medicaldoctor) 5181 who performs treatment for an affected area of a patient5185 on the patient bed 5183 and the entire surgery room. The ceilingcamera 5187 and the surgery field camera 5189 may include amagnification adjustment function, a focal distance adjustment function,an imaging direction adjustment function and so forth. The illumination5191 is provided on the ceiling of the surgery room and irradiates lightat least upon the hands of the surgeon 5181. The illumination 5191 maybe configured such that the irradiation light amount, the wavelength(color) of the irradiation light, the irradiation direction of the lightand so forth can be adjusted suitably.

The endoscopic surgery system 5113, the patient bed 5183, the ceilingcamera 5187, the surgery field camera 5189 and the illumination 5191 areconnected for cooperation with each other through the audiovisualcontroller 5107 and the surgery room controlling apparatus 5109 (notdepicted in FIG. 15) as depicted in FIG. 13. The centralized operationpanel 5111 is provided in the surgery room, and the user can suitablyoperate the apparatus existing in the surgery room through thecentralized operation panel 5111 as described hereinabove.

In the following, a configuration of the endoscopic surgery system 5113is described in detail. As depicted, the endoscopic surgery system 5113includes an endoscope 5115, other surgical tools 5131, a supporting armapparatus 5141 which supports the endoscope 5115 thereon, and a cart5151 on which various apparatus for endoscopic surgery are mounted.

In endoscopic surgery, in place of incision of the abdominal wall toperform laparotomy, a plurality of tubular aperture devices calledtrocars 5139 a to 5139 d are used to puncture the abdominal wall. Then,a lens barrel 5117 of the endoscope 5115 and the other surgical tools5131 are inserted into body lumens of the patient 5185 through thetrocars 5139 a to 5139 d. In the example depicted, as the other surgicaltools 5131, a pneumoperitoneum tube 5133, an energy treatment tool 5135and forceps 5137 are inserted into body lumens of the patient 5185.Further, the energy treatment tool 5135 is a treatment tool forperforming incision and peeling of a tissue, sealing of a blood vesselor the like by high frequency current or ultrasonic vibration. However,the surgical tools 5131 depicted are mere examples at all, and as thesurgical tools 5131, various surgical tools which are generally used inendoscopic surgery such as, for example, a pair of tweezers or aretractor may be used.

An image of a surgical region in a body lumen of the patient 5185 pickedup by the endoscope 5115 is displayed on a display apparatus 5155. Thesurgeon 5181 would use the energy treatment tool 5135 or the forceps5137 while watching the image of the surgical region displayed on thedisplay apparatus 5155 on the real time basis to perform such treatmentas, for example, resection of an affected area. It is to be noted that,though not depicted, the pneumoperitoneum tube 5133, the energytreatment tool 5135, and the forceps 5137 are supported by the surgeon5181, an assistant or the like during surgery.

(Supporting Arm Apparatus)

The supporting arm apparatus 5141 includes an arm unit 5145 extendingfrom a base unit 5143. In the example depicted, the arm unit 5145includes joint portions 5147 a, 5147 b and 5147 c and links 5149 a and5149 b and is driven under the control of an arm controlling apparatus5159. The endoscope 5115 is supported by the arm unit 5145 such that theposition and the posture of the endoscope 5115 are controlled.Consequently, stable fixation in position of the endoscope 5115 can beimplemented.

(Endoscope)

The endoscope 5115 includes the lens barrel 5117 which has a region of apredetermined length from a distal end thereof to be inserted into abody lumen of the patient 5185, and a camera head 5119 connected to aproximal end of the lens barrel 5117. In the example depicted, theendoscope 5115 is depicted which is configured as a hard mirror havingthe lens barrel 5117 of the hard type. However, the endoscope 5115 mayotherwise be configured as a soft mirror having the lens barrel 5117 ofthe soft type.

The lens barrel 5117 has, at a distal end thereof, an opening in whichan objective lens is fitted. A light source apparatus 5157 is connectedto the endoscope 5115 such that light generated by the light sourceapparatus 5157 is introduced to a distal end of the lens barrel 5117 bya light guide extending in the inside of the lens barrel 5117 and isirradiated toward an observation target in a body lumen of the patient5185 through the objective lens. It is to be noted that the endoscope5115 may be a direct view mirror or may be a perspective view mirror ora side view mirror.

An optical system and an image pickup element are provided in the insideof the camera head 5119 such that reflected light (observation light)from an observation target is condensed on the image pickup element bythe optical system. The observation light is photo-electricallyconverted by the image pickup element to generate an electric signalcorresponding to the observation light, namely, an image signalcorresponding to an observation image. The image signal is transmittedas RAW data to a CCU 5153. It is to be noted that the camera head 5119has a function incorporated therein for suitably driving the opticalsystem of the camera head 5119 to adjust the magnification and the focaldistance.

It is to be noted that, in order to establish compatibility with, forexample, a stereoscopic vision (3D display), a plurality of image pickupelements may be provided on the camera head 5119. In this case, aplurality of relay optical systems are provided in the inside of thelens barrel 5117 in order to guide observation light to the plurality ofrespective image pickup elements.

(Various Apparatus Incorporated in Cart)

The CCU 5153 includes a central processing unit (CPU), a graphicsprocessing unit (GPU) or the like and integrally controls operation ofthe endoscope 5115 and the display apparatus 5155. Specifically, the CCU5153 performs, for an image signal received from the camera head 5119,various image processes for displaying an image based on the imagesignal such as, for example, a development process (demosaic process).The CCU 5153 provides the image signal for which the image processeshave been performed to the display apparatus 5155. Further, theaudiovisual controller 5107 depicted in FIG. 13 is connected to the CCU5153. The CCU 5153 provides the image signal for which the imageprocesses have been performed also to the audiovisual controller 5107.Further, the CCU 5153 transmits a control signal to the camera head 5119to control driving of the camera head 5119. The control signal mayinclude information relating to an image pickup condition such as amagnification or a focal distance. The information relating to an imagepickup condition may be inputted through the inputting apparatus 5161 ormay be inputted through the centralized operation panel 5111 describedhereinabove.

The display apparatus 5155 displays an image based on an image signalfor which the image processes have been performed by the CCU 5153 underthe control of the CCU 5153. If the endoscope 5115 is ready for imagingof a high resolution such as 4K (horizontal pixel number 3840×verticalpixel number 2160), 8K (horizontal pixel number 7680×vertical pixelnumber 4320) or the like and/or ready for 3D display, then a displayapparatus by which corresponding display of the high resolution and/or3D display are possible may be used as the display apparatus 5155. Wherethe apparatus is ready for imaging of a high resolution such as 4K or8K, if the display apparatus used as the display apparatus 5155 has asize of equal to or not less than 55 inches, then a more immersiveexperience can be obtained. Further, a plurality of display apparatus5155 having different resolutions and/or different sizes may be providedin accordance with purposes.

The light source apparatus 5157 includes a light source such as, forexample, a light emitting diode (LED) and supplies irradiation light forimaging of a surgical region to the endoscope 5115.

The arm controlling apparatus 5159 includes a processor such as, forexample, a CPU and operates in accordance with a predetermined programto control driving of the arm unit 5145 of the supporting arm apparatus5141 in accordance with a predetermined controlling method.

An inputting apparatus 5161 is an input interface for the endoscopicsurgery system 5113. A user can perform inputting of various kinds ofinformation or instruction inputting to the endoscopic surgery system5113 through the inputting apparatus 5161. For example, the user wouldinput various kinds of information relating to surgery such as physicalinformation of a patient, information regarding a surgical procedure ofthe surgery and so forth through the inputting apparatus 5161. Further,the user would input, for example, an instruction to drive the arm unit5145, an instruction to change an image pickup condition (type ofirradiation light, magnification, focal distance or the like) by theendoscope 5115, an instruction to drive the energy treatment tool 5135or a like through the inputting apparatus 5161.

The type of the inputting apparatus 5161 is not limited and may be thatof any one of various known inputting apparatus. As the inputtingapparatus 5161, for example, a mouse, a keyboard, a touch panel, aswitch, a foot switch 5171 and/or a lever or the like may be applied.Where a touch panel is used as the inputting apparatus 5161, it may beprovided on the display face of the display apparatus 5155.

The inputting apparatus 5161 is otherwise a device to be mounted on auser such as, for example, a glasses type wearable device or a headmounted display (HMD), and various kinds of inputting are performed inresponse to a gesture or a line of sight of the user detected by any ofthe devices mentioned. Further, the inputting apparatus 5161 includes acamera which can detect a motion of a user, and various kinds ofinputting are performed in response to a gesture or a line of sight of auser detected from a video picked up by the camera. Further, theinputting apparatus 5161 includes a microphone which can collect thevoice of a user, and various kinds of inputting are performed by voicethrough the microphone. By configuring the inputting apparatus 5161 suchthat various kinds of information can be inputted in a contactlessfashion in this manner, especially a user who belongs to a clean area(for example, the surgeon 5181) can operate an apparatus belonging to anunclean area in a contactless fashion. Further, since the user canoperate an apparatus without releasing a possessed surgical tool fromits hand, the convenience to the user is improved.

A treatment tool controlling apparatus 5163 controls driving of theenergy treatment tool 5135 for cautery or incision of a tissue, sealingof a blood vessel or the like. A pneumoperitoneum apparatus 5165 feedsgas into a body lumen of the patient 5185 through the pneumoperitoneumtube 5133 to inflate the body lumen in order to secure the field of viewof the endoscope 5115 and secure the working space for the surgeon. Arecorder 5167 is an apparatus capable of recording various kinds ofinformation relating to surgery. A printer 5169 is an apparatus capableof printing various kinds of information relating to surgery in variousforms such as a text, an image or a graph.

In the following, especially a characteristic configuration of theendoscopic surgery system 5113 is described in more detail.

(Supporting Arm Apparatus)

The supporting arm apparatus 5141 includes the base unit 5143 serving asa base, and the arm unit 5145 extending from the base unit 5143. In theexample depicted, the arm unit 5145 includes the plurality of jointportions 5147 a, 5147 b and 5147 c and the plurality of links 5149 a and5149 b connected to each other by the joint portion 5147 b. In FIG. 15,for simplified illustration, the configuration of the arm unit 5145 isdepicted in a simplified form. Actually, the shape, number andarrangement of the joint portions 5147 a to 5147 c and the links 5149 aand 5149 b and the direction and so forth of axes of rotation of thejoint portions 5147 a to 5147 c can be set suitably such that the armunit 5145 has a desired degree of freedom. For example, the arm unit5145 may preferably be included such that it has a degree of freedomequal to or not less than 6 degrees of freedom. This makes it possibleto move the endoscope 5115 freely within the movable range of the armunit 5145. Consequently, it becomes possible to insert the lens barrel5117 of the endoscope 5115 from a desired direction into a body lumen ofthe patient 5185.

An actuator is provided in the joint portions 5147 a to 5147 c, and thejoint portions 5147 a to 5147 c include such that they are rotatablearound predetermined axes of rotation thereof by driving of theactuator. The driving of the actuator is controlled by the armcontrolling apparatus 5159 to control the rotational angle of each ofthe joint portions 5147 a to 5147 c thereby to control driving of thearm unit 5145. Consequently, control of the position and the posture ofthe endoscope 5115 can be implemented. Thereupon, the arm controllingapparatus 5159 can control driving of the arm unit 5145 by various knowncontrolling methods such as force control or position control.

For example, if the surgeon 5181 suitably performs operation inputtingthrough the inputting apparatus 5161 (including the foot switch 5171),then driving of the arm unit 5145 may be controlled suitably by the armcontrolling apparatus 5159 in response to the operation input to controlthe position and the posture of the endoscope 5115. After the endoscope5115 at the distal end of the arm unit 5145 is moved from an arbitraryposition to a different arbitrary position by the control justdescribed, the endoscope 5115 can be supported fixedly at the positionafter the movement. It is to be noted that the arm unit 5145 may beoperated in a master-slave fashion. In this case, the arm unit 5145 maybe remotely controlled by the user through the inputting apparatus 5161which is placed at a place remote from the surgery room.

Further, where force control is applied, the arm controlling apparatus5159 may perform power-assisted control to drive the actuators of thejoint portions 5147 a to 5147 c such that the arm unit 5145 may receiveexternal force by the user and move smoothly following the externalforce. This makes it possible to move the arm unit 5145 withcomparatively weak force when the user directly touches with and movesthe arm unit 5145. Accordingly, it becomes possible for the user to movethe endoscope 5115 more intuitively by a simpler and easier operation,and the convenience to the user can be improved.

Here, generally in endoscopic surgery, the endoscope 5115 is supportedby a medical doctor called scopist. In contrast, where the supportingarm apparatus 5141 is used, the position of the endoscope 5115 can befixed with a higher degree of certainty without hands, and therefore, animage of a surgical region can be obtained stably and surgery can beperformed smoothly.

It is to be noted that the arm controlling apparatus 5159 may notnecessarily be provided on the cart 5151. Further, the arm controllingapparatus 5159 may not necessarily be a single apparatus. For example,the arm controlling apparatus 5159 may be provided in each of the jointportions 5147 a to 5147 c of the arm unit 5145 of the supporting armapparatus 5141 such that the plurality of arm controlling apparatus 5159cooperate with each other to implement driving control of the arm unit5145.

(Light Source Apparatus)

The light source apparatus 5157 supplies irradiation light upon imagingof a surgical region to the endoscope 5115. The light source apparatus5157 includes a white light source which includes, for example, an LED,a laser light source or a combination of them. In this case, where awhite light source includes a combination of red, green, and blue (RGB)laser light sources, since the output intensity and the output timingcan be controlled with a high degree of accuracy for each color (eachwavelength), adjustment of the white balance of a picked up image can beperformed by the light source apparatus 5157. Further, in this case, iflaser beams from the RGB laser light sources are irradiatedtime-divisionally on an observation target and driving of the imagepickup elements of the camera head 5119 is controlled in synchronismwith the irradiation timings, then images individually corresponding tothe R, G and B colors can be picked up time-divisionally. According tothe method just described, a color image can be obtained even if a colorfilter is not provided for the image pickup element.

Further, driving of the light source apparatus 5157 may be controlledsuch that the intensity of light to be outputted is changed for eachpredetermined time. By controlling driving of the image pickup elementof the camera head 5119 in synchronism with the timing of the change ofthe intensity of light to acquire images time-divisionally andsynthesizing the images, an image of a high dynamic range free fromunderexposed blocked up shadows and overexposed highlights can becreated.

Further, the light source apparatus 5157 may be configured to supplylight of a predetermined wavelength band ready for special lightobservation. In special light observation, for example, by utilizing thewavelength dependency of absorption of light of a body tissue toirradiate light of a narrower band in comparison with irradiation lightupon ordinary observation (namely, white light), narrow band lightobservation (narrow band imaging) of imaging a predetermined tissue suchas a blood vessel of a superficial portion of the mucous membrane or thelike in a high contrast is performed. Alternatively, in special lightobservation, fluorescent observation for obtaining an image fromfluorescent light generated by irradiation of excitation light may alsobe performed. In fluorescent observation, it is possible to performobservation of fluorescent light from a body tissue by irradiatingexcitation light on the body tissue (autofluorescence observation) or toobtain a fluorescent light image by locally injecting a reagent such asindocyanine green (ICG) into a body tissue and irradiating excitationlight corresponding to a fluorescent light wavelength of the reagentupon the body tissue. The light source apparatus 5157 can be configuredto supply such narrow-band light and/or excitation light suitable forspecial light observation as described above.

(Camera Head and CCU)

Functions of the camera head 5119 of the endoscope 5115 and the CCU 5153are described in more detail with reference to FIG. 16. FIG. 16 is ablock diagram depicting an example of a functional configuration of thecamera head 5119 and the CCU 5153 depicted in FIG. 15.

Referring to FIG. 16, the camera head 5119 has, as functions thereof, alens unit 5121, an image pickup unit 5123, a driving unit 5125, acommunication unit 5127 and a camera head controlling unit 5129.Further, the CCU 5153 has, as functions thereof, a communication unit5173, an image processing unit 5175 and a control unit 5177. The camerahead 5119 and the CCU 5153 are connected to be bidirectionallycommunicable to each other by a transmission cable 5179.

First, a functional configuration of the camera head 5119 is described.The lens unit 5121 is an optical system provided at a connectinglocation of the camera head 5119 to the lens barrel 5117. Observationlight taken in from a distal end of the lens barrel 5117 is introducedinto the camera head 5119 and enters the lens unit 5121. The lens unit5121 includes a combination of a plurality of lenses including a zoomlens and a focusing lens. The lens unit 5121 has optical propertiesadjusted such that the observation light is condensed on a lightreceiving face of the image pickup element of the image pickup unit5123. Further, the zoom lens and the focusing lens include such that thepositions thereof on their optical axis are movable for adjustment ofthe magnification and the focal point of a picked up image.

The image pickup unit 5123 includes an image pickup element and disposedat a succeeding stage to the lens unit 5121. Observation light havingpassed through the lens unit 5121 is condensed on the light receivingface of the image pickup element, and an image signal corresponding tothe observation image is generated by photoelectric conversion. Theimage signal generated by the image pickup unit 5123 is provided to thecommunication unit 5127.

As the image pickup element which is included by the image pickup unit5123, an image sensor, for example, of the complementary metal oxidesemiconductor (CMOS) type is used which has a Bayer array and is capableof picking up an image in color. It is to be noted that, as the imagepickup element, an image pickup element may be used which is ready, forexample, for imaging of an image of a high resolution equal to or notless than 4K. If an image of a surgical region is obtained in a highresolution, then the surgeon 5181 can comprehend a state of the surgicalregion in enhanced details and can proceed with the surgery moresmoothly.

Further, the image pickup element which is included by the image pickupunit 5123 is configured such that it has a pair of image pickup elementsfor acquiring image signals for the right eye and the left eyecompatible with 3D display. Where 3D display is applied, the surgeon5181 can comprehend the depth of a living body tissue in the surgicalregion with a higher degree of accuracy. It is to be noted that, if theimage pickup unit 5123 is configured as that of the multi-plate type,then a plurality of systems of lens units 5121 are providedcorresponding to the individual image pickup elements of the imagepickup unit 5123.

The image pickup unit 5123 may not necessarily be provided on the camerahead 5119. For example, the image pickup unit 5123 may be provided justbehind the objective lens in the inside of the lens barrel 5117.

The driving unit 5125 includes an actuator and moves the zoom lens andthe focusing lens of the lens unit 5121 by a predetermined distancealong the optical axis under the control of the camera head controllingunit 5129. Consequently, the magnification and the focal point of apicked up image by the image pickup unit 5123 can be adjusted suitably.

The communication unit 5127 includes a communication apparatus fortransmitting and receiving various kinds of information to and from theCCU 5153. The communication unit 5127 transmits an image signal acquiredfrom the image pickup unit 5123 as RAW data to the CCU 5153 through thetransmission cable 5179. Thereupon, in order to display a picked upimage of a surgical region in low latency, preferably the image signalis transmitted by optical communication. This is because, since, uponsurgery, the surgeon 5181 performs surgery while observing the state ofan affected area through a picked up image, in order to achieve surgerywith a higher degree of safety and certainty, it is demanded for amoving image of the surgical region to be displayed on the real timebasis as far as possible. Where optical communication is applied, aphotoelectric conversion module for converting an electric signal intoan optical signal is provided in the communication unit 5127. After theimage signal is converted into an optical signal by the photoelectricconversion module, it is transmitted to the CCU 5153 through thetransmission cable 5179.

Further, the communication unit 5127 receives a control signal forcontrolling driving of the camera head 5119 from the CCU 5153. Thecontrol signal includes information relating to image pickup conditionssuch as, for example, information that a frame rate of a picked up imageis designated, information that an exposure value upon image picking upis designated and/or information that a magnification and a focal pointof a picked up image are designated. The communication unit 5127provides the received control signal to the camera head controlling unit5129. It is to be noted that also the control signal from the CCU 5153may be transmitted by optical communication. In this case, aphotoelectric conversion module for converting an optical signal into anelectric signal is provided in the communication unit 5127. After thecontrol signal is converted into an electric signal by the photoelectricconversion module, it is provided to the camera head controlling unit5129.

It is to be noted that the image pickup conditions such as the framerate, exposure value, magnification or focal point are set automaticallyby the control unit 5177 of the CCU 5153 on the basis of an acquiredimage signal. In other words, an auto exposure (AE) function, an autofocus (AF) function and an auto white balance (AWB) function areincorporated in the endoscope 5115.

The camera head controlling unit 5129 controls driving of the camerahead 5119 on the basis of a control signal from the CCU 5153 receivedthrough the communication unit 5127. For example, the camera headcontrolling unit 5129 controls driving of the image pickup element ofthe image pickup unit 5123 on the basis of information that a frame rateof a picked up image is designated and/or information that an exposurevalue upon image picking up is designated. Further, for example, thecamera head controlling unit 5129 controls the driving unit 5125 tosuitably move the zoom lens and the focus lens of the lens unit 5121 onthe basis of information that a magnification and a focal point of apicked up image are designated. The camera head controlling unit 5129may include a function for storing information for identifying of thelens barrel 5117 and/or the camera head 5119.

It is to be noted that, by disposing the components such as the lensunit 5121 and the image pickup unit 5123 in a sealed structure havinghigh airtightness and high waterproof, the camera head 5119 can beprovided with resistance to an autoclave sterilization process.

Now, a functional configuration of the CCU 5153 is described. Thecommunication unit 5173 includes a communication apparatus fortransmitting and receiving various kinds of information to and from thecamera head 5119. The communication unit 5173 receives an image signaltransmitted thereto from the camera head 5119 through the transmissioncable 5179. Thereupon, the image signal may be transmitted preferably byoptical communication as described above. In this case, for thecompatibility with optical communication, the communication unit 5173includes a photoelectric conversion module for converting an opticalsignal into an electric signal. The communication unit 5173 provides theimage signal after conversion into an electric signal to the imageprocessing unit 5175.

Further, the communication unit 5173 transmits, to the camera head 5119,a control signal for controlling driving of the camera head 5119. Alsothe control signal may be transmitted by optical communication.

The image processing unit 5175 performs various image processes for animage signal in the form of RAW data transmitted thereto from the camerahead 5119. The image processes include various known signal processessuch as, for example, a development process, an image quality improvingprocess (a bandwidth enhancement process, a super-resolution process, anoise reduction (NR) process and/or an image stabilization process)and/or an enlargement process (electronic zooming process). Further, theimage processing unit 5175 performs a detection process for an imagesignal for performing AE, AF and AWB.

The image processing unit 5175 includes a processor such as a CPU or aGPU, and when the processor operates in accordance with a predeterminedprogram, the image processes and the detection process described abovecan be performed. It is to be noted that, where the image processingunit 5175 includes a plurality of GPUs, the image processing unit 5175suitably divides information relating to an image signal such that imageprocesses are performed in parallel by the plurality of GPUs.

The control unit 5177 performs various kinds of control relating toimage picking up of a surgical region by the endoscope 5001 and displayof the picked up image. For example, the control unit 5177 generates acontrol signal for controlling driving of the camera head 5119.Thereupon, if image pickup conditions are inputted by the user, then thecontrol unit 5177 generates a control signal on the basis of the inputby the user. Alternatively, where the endoscope 5115 has an AE function,an AF function and an AWB function incorporated therein, the controlunit 5177 suitably calculates an optimum exposure value, focal distanceand white balance in response to a result of a detection process by theimage processing unit 5175 and generates a control signal.

Further, the control unit 5177 controls the display apparatus 5155 todisplay an image of a surgical region on the basis of an image signalfor which the image processes have been performed by the imageprocessing unit 5175. Thereupon, the control unit 5177 recognizesvarious objects in the surgical region image using various imagerecognition technologies. For example, the control unit 5177 canrecognize a surgical tool such as forceps, a particular living bodyregion, bleeding, mist when the energy treatment tool 5135 is used andso forth by detecting the shape, color and so forth of edges of theobjects included in the surgical region image. The control unit 5177causes, when it controls the display unit 5155 to display a surgicalregion image, various kinds of surgery supporting information to bedisplayed in an overlapping manner with an image of the surgical regionusing a result of the recognition. Where surgery supporting informationis displayed in an overlapping manner and presented to the surgeon 5181,the surgeon 5181 can proceed with the surgery more safety and certainty.

The transmission cable 5179 which connects the camera head 5119 and theCCU 5153 to each other is an electric signal cable ready forcommunication of an electric signal, an optical fiber ready for opticalcommunication or a composite cable thereof.

Here, while, in the example depicted in the figure, communication isperformed by wired communication using the transmission cable 5179, thecommunication between the camera head 5119 and the CCU 5153 may beperformed otherwise by wireless communication. Where the communicationbetween the camera head 5119 and the CCU 5153 is performed by wirelesscommunication, there is no necessity to lay the transmission cable 5179in the surgery room. Therefore, such a situation that movement ofmedical staff in the surgery room is disturbed by the transmission cable5179 can be eliminated.

An example of the surgery room system 5100 to which the technologyaccording to an embodiment of the present disclosure can be applied hasbeen described above. It is to be noted here that, although a case inwhich the medical system to which the surgery room system 5100 isapplied is the endoscopic surgery system 5113 has been described as anexample, the configuration of the surgery room system 5100 is notlimited to that of the example described above. For example, the surgeryroom system 5100 may be applied to a soft endoscopic system forinspection or a microscopic surgery system in place of the endoscopicsurgery system 5113.

The present disclosure may have the following configurations.

(1) A multi-camera system, including a first camera apparatus; a secondcamera apparatus; and an information processing apparatus, including acommunication interface; and processing circuitry configured to receivea predetermined user input; and in response to the predetermined userinput, send, via the communication interface, a first control signal tothe first camera apparatus that captures a first video, and send, viathe communication interface, a second control signal to the secondcamera apparatus that captures a second video, in which the firstcontrol signal causes the first camera apparatus to assign first uniqueidentifiers to frames of the first video captured by the first cameraapparatus, the second control signal causes the second camera apparatusto assign second unique identifiers to frames of the second videocaptured by the second camera apparatus, and each of the first uniqueidentifiers assigned to the frames of the first video is associated witha different one of the second unique identifiers assigned to the framesof the second video.(2) An information processing apparatus, including a communicationinterface; and processing circuitry configured to receive apredetermined user input; and in response to the predetermined userinput, send, via the communication interface, a first control signal toa first camera apparatus that captures a first video, and send, via thecommunication interface, a second control signal to a second cameraapparatus that captures a second video, in which the first controlsignal causes the first camera apparatus to assign first uniqueidentifiers to frames of the first video captured by the first cameraapparatus, the second control signal causes the second camera apparatusto assign second unique identifiers to frames of the second videocaptured by the second camera apparatus, and each of the first uniqueidentifiers assigned to the frames of the first video is associated witha different one of the second unique identifiers assigned to the framesof the second video.(3) The information processing apparatus according to feature (2), inwhich a field of view of the first camera apparatus is different from afield of view of the second camera apparatus.(4) The information processing apparatus according to feature (2) or(3), in which the assigned first and second unique identifiers indicateone-to-one correspondences between the frames of the first video and theframes of the second video.(5) The information processing apparatus according to any one offeatures (2) to (4), in which the first and second unique identifiersare the same unique identifiers.(6) The information processing apparatus according to any one offeatures (2) to (5), in which the first control signal causes the firstcamera apparatus to assign the first unique identifiers to a number of atotal number of frames of the first video, the number of frames beingless than the total number of frames of the first video, and the secondcontrol signal causes the second camera apparatus to assign the secondunique identifiers to the same number of frames of the second video.(7) The information processing apparatus according to any one offeatures (2) to (6), in which the first control signal causes the firstcamera apparatus to assign the first unique identifiers in the reverseorder of capture, and the second control signal causes the second cameraapparatus to assign the second unique identifiers in the reverse orderof capture.(8) An information processing apparatus, including a communicationinterface; and processing circuitry configured to transmit, via thecommunication interface, a first unique identifier of a frame of a firstvideo to a first camera apparatus, which captured the first video;receive at least one frame of the first video including the framecorresponding to the first unique identifier from the first cameraapparatus in response to the transmitted first unique identifier, eachof the at least one frame of the first video corresponding to adifferent one of a plurality of first unique identifiers; output one ormore of the at least one video frame of the first video for display to auser; receive a predetermined user input during the output of the one ormore of the at least one video frame of the first video for display tothe user; and in response to the received predetermined user input,transmit, via the communication interface, a second unique identifier ofa frame of a second video to a second camera apparatus, which capturedthe second video, the second unique identifier being associated with thefirst unique identifier of one of the at least one frame of the firstvideo, receive at least one frame of the second video including theframe corresponding to the second unique identifier from the secondcamera apparatus in response to the transmitted second uniqueidentifier, each of the at least one frame of the second videocorresponding to a different one of a plurality of second uniqueidentifiers, and output one or more of the at least one video frame ofthe second video for display to the user.(9) The information processing apparatus according to feature (8), inwhich the field of view of the first camera apparatus is different fromthe field of view of the second camera apparatus.(10) The information processing apparatus according to feature (8) or(9), in which the first and second unique identifiers are the sameunique identifiers.(11) A non-transitory computer-readable medium storing instructionswhich when executed by a computer cause the computer to perform a methodof controlling cameras to assign unique identifiers to frames ofcaptured video, the method including receiving a predetermined userinput; and in response to the predetermined user input, send, via acommunication interface, a first control signal to a first cameraapparatus that captures a first video, and send, via the communicationinterface, a second control signal to a second camera apparatus thatcaptures a second video, in which the first control signal causes thefirst camera apparatus to assign first unique identifiers to frames ofthe first video captured by the first camera apparatus, the secondcontrol signal causes the second camera apparatus to assign secondunique identifiers to frames of the second video captured by the secondcamera apparatus, and each of the first unique identifiers assigned tothe frames of the first video is associated with a different one of thesecond unique identifiers assigned to the frames of the second video.(12) The non-transitory computer-readable medium according to feature(11), in which a field of view of the first camera apparatus isdifferent from a field of view of the second camera apparatus.(13) The non-transitory computer-readable medium according to feature(11) or (12), in which the assigned first and second unique identifiersindicate one-to-one correspondences between the frames of the firstvideo and the frames of the second video.(14) The non-transitory computer-readable medium according to any offeatures (11) to (13), in which the first and second unique identifiersare the same unique identifiers.(15) The non-transitory computer-readable medium according to any one offeatures (11) to (14), in which the first control signal causes thefirst camera apparatus to assign the first unique identifiers to anumber of a total number of frames of the first video, the number offrames being less than the total number of frames of the first video,and the second control signal causes the second camera apparatus toassign the second unique identifiers to the same number of frames of thesecond video.(16) The non-transitory computer-readable medium according to any offeatures (11) to (15), in which the first control signal causes thefirst camera apparatus to assign the first unique identifiers in thereverse order of capture, and the second control signal causes thesecond camera apparatus to assign the second unique identifiers in thereverse order of capture.(17) A non-transitory computer-readable medium storing instructionswhich when executed by a computer cause the computer to perform a methodof playing back video recorded by a plurality of cameras, the methodincluding transmitting, via a communication interface, a first uniqueidentifier of a frame of a first video to a first camera apparatus,which captured the first video; receiving at least one frame of thefirst video including the frame corresponding to the first uniqueidentifier from the first camera apparatus in response to thetransmitted first unique identifier, each of the at least one frame ofthe first video corresponding to a different one of a plurality of firstunique identifiers; output one or more of the at least one video frameof the first video for display to a user; receive a user input duringthe output of the one or more of the at least one video frame of thefirst video for display to the user; and in response to the receiveduser input, transmit, via the communication interface, a second uniqueidentifier of a frame of a second video to a second camera apparatus,which captured the second video, the second unique identifier beingassociated with the first unique identifier of one of the at least oneframe of the first video, receive at least one frame of the second videoincluding the frame corresponding to the second unique identifier fromthe second camera apparatus in response to the transmitted second uniqueidentifier, each of the at least one frame of the second videocorresponding to a different one of a plurality of second uniqueidentifiers, and output one or more of the at least one video frame ofthe second video for display to the user.

(18) The non-transitory computer-readable medium according to feature(17), in which the field of view of the first camera apparatus isdifferent from the field of view of the second camera apparatus.

(19) The non-transitory computer-readable medium according to feature(17) or (18), in which the first and second unique identifiers are thesame unique identifiers.

The present disclosure may also have the following configurations.

(1) A multi-camera system, including:

a plurality of cameras; and

a confirmation apparatus connected via wire or wirelessly to theplurality of cameras,

each of the cameras including

-   -   an imager,    -   a memory that writes image data of frames captured by the        imager, and    -   a control unit that controls processing of, when receiving an        end trigger signal from the confirmation apparatus, assigning        frame numbers to the frames within a predetermined past time        period starting from the frame corresponding to a timing of        receiving the end trigger signal, and processing of, when        receiving a transfer request including the frame number from the        confirmation apparatus, reading the image data of the frame        specified by the frame number from the memory and transferring        to the confirmation apparatus,

the confirmation apparatus including

-   -   a display, and    -   a control unit that controls processing of sending the end        trigger signal to each of the plurality of cameras, processing        of sending the transfer request including the frame number to a        predetermined camera selected from the plurality of cameras, and        processing of receiving the image data of the frame specified by        the frame number transferred from the predetermined camera, and        displaying an image of the image data on the display.        (2) The multi-camera system according to (1), in which

the plurality of cameras capture images of a same object at differentangles.

(3) A camera, including:

an imager;

a memory that writes image data of frames captured by the imager; and

a control unit that controls processing of, when receiving an endtrigger signal from the confirmation apparatus, assigning frame numbersto the frames within a predetermined past time period starting from theframe corresponding to a timing of receiving the end trigger signal, andprocessing of, when receiving a transfer request including the framenumber from the confirmation apparatus, reading the image data of theframe specified by the frame number from the memory and transferring tothe confirmation apparatus.

(4) The camera according to (3), in which

the image data of the frames is intraframe-compressed, and is writteninto the memory, and

the intraframe-compressed image data of the frame specified by the framenumber is transferred to the confirmation apparatus.

(5) The camera according to (3) or (4), in which

the image data of each frame is loop-recorded in the memory for at leastpredetermined time or longer.

(6) A processing method of a camera, the camera including an imager anda memory that writes image data of frames captured by the imager, themethod including the steps of:

when receiving an end trigger signal from a confirmation apparatus,assigning frame numbers to the frames within a predetermined past timeperiod starting from the frame corresponding to a timing of receivingthe end trigger signal; and

when receiving a transfer request including a frame number from theconfirmation apparatus, reading the image data of the frame specified bythe frame number from the memory and transferring the image data to theconfirmation apparatus.

(7) A confirmation apparatus, including:

a display; and

a control unit that controls processing of sending the end triggersignal to each of the plurality of cameras, processing of sending thetransfer request including the frame number to a predetermined cameraselected from the plurality of cameras, and processing of receiving theimage data of the frame specified by the frame number transferred fromthe predetermined camera, and displaying an image of the image data onthe display.

(8) The confirmation apparatus according to (7), further including:

an operation part configured to switch an image taken by thepredetermined camera to an image taken by the other camera.

(9) The confirmation apparatus according to (8), in which

the operation part is a touch panel arranged on a screen of the display.

(10) The confirmation apparatus according to claim 9, in which

a button and/or a scroll bar configured to switch the image taken by thepredetermined camera to the image taken by the other camera is displayedon the display.

(11) A processing method of a confirmation apparatus, the confirmationapparatus including a display, the method including the steps of:

sending an end trigger signal to each of a plurality of cameras;

sending a transfer request including a frame number to a predeterminedcamera selected from the plurality of cameras; and

receiving image data of the frame specified by the frame numbertransferred from the predetermined camera, and displaying an image ofthe image data on the display.

REFERENCE SIGNS LIST

-   10A, 10B, 10C, 10D multi-camera system-   101, 101-A, 101-B, and 101-C camera-   102 confirmation apparatus-   103-A, 103-B, 103-C control device-   111 CPU-   112 memory-   113 imager/lens-   114 camera signal processing unit-   115 codec processing unit-   116 panel processing unit-   117 panel-   118 wired communication processing unit-   119 wired LAN terminal-   120 wireless communication processing unit-   121 antenna-   131 CPU-   132 memory-   133 codec processing unit-   134 graphic processing unit-   135 panel processing unit-   136 panel-   137 wired communication processing unit-   138 wired LAN terminal-   139 wireless communication processing unit-   140 antenna

The invention claimed is:
 1. An information processing apparatus,comprising: a communication interface; and processing circuitryconfigured to: in response to a predetermined trigger signal, send, viathe communication interface, a first control signal to a first cameraapparatus that captures a first video, and send, via the communicationinterface, a second control signal to a second camera apparatus thatcaptures a second video, wherein the first control signal causes thefirst camera apparatus to assign a first unique identifier to a frame ofthe first video that is recorded in a frame buffer of the first cameraapparatus, the second control signal causes the second camera apparatusto assign a second unique identifier to a frame of the second video thatis recorded in a frame buffer of the second camera apparatus, the firstunique identifier is associated with the second unique identifier, afirst assigned frame in the frame buffer of the first camera apparatuscorresponds to a timing of reception of the first control signal, and afirst assigned frame in the frame buffer of the second camera apparatuscorresponds to a timing of reception of the second control signal. 2.The information processing apparatus according to claim 1, furthercomprising: a third camera apparatus configured to capture a thirdvideo, and a third frame buffer, wherein the processing circuitry isfurther configured to assign a third unique identifier to a frame of thethird video in response to the predetermined trigger signal, the frameof the third video being recorded in the frame buffer of the informationprocessing apparatus, and the third unique identifier is associated withthe first unique identifier.
 3. The information processing apparatusaccording to claim 1, wherein a field of view of the first cameraapparatus is different from a field of view of the second cameraapparatus.
 4. The information processing apparatus according to claim 1,wherein the assigned first and second unique identifiers indicate aone-to-one correspondences correspondence between the frame of the firstvideo and the frame of the second video.
 5. The information processingapparatus according to claim 1, wherein the first and second uniqueidentifiers are the same unique identifiers.
 6. The informationprocessing apparatus according to claim 1, wherein the first controlsignal causes the first camera apparatus to assign the first uniqueidentifier to a first number of frames of a total number of frames ofthe first video, the first number of frames being less than the totalnumber of frames of the first video, the second control signal causesthe second camera apparatus to assign the second unique identifier to asecond number of frames of the second video, and the first number offrames is equal to the second number of frames.
 7. The informationprocessing apparatus according to claim 1, wherein the first controlsignal causes the first camera apparatus to assign the first uniqueidentifier in a reverse order of capture, and the second control signalcauses the second camera apparatus to assign the second uniqueidentifier in the reverse order of capture.
 8. An information processingapparatus, comprising: a communication interface; and processingcircuitry configured to: transmit, via the communication interface, afirst unique identifier of a frame of a first video to a first cameraapparatus; receive the frame of the first video in response to thetransmitted first unique identifier; output the received frame of thefirst video for display to a user; in response to a predeterminedtrigger signal, transmit, via the communication interface, a secondunique identifier of a frame of a second video to a second cameraapparatus, the frame of the second video being recorded in a framebuffer of the second camera apparatus, the second unique identifierbeing associated with the first unique identifier of the frame of thefirst video, and output, from the frame buffer of the second cameraapparatus, the frame of the second video for display to the user,wherein the frame corresponding to the second unique identifier from thesecond camera apparatus is a first assigned frame in the frame buffer ofthe second camera apparatus corresponding to a timing of reception ofthe predetermined trigger signal.
 9. The information processingapparatus according to claim 8, wherein a field of view of the firstcamera apparatus is different from a field of view of the second cameraapparatus.
 10. The information processing apparatus according to claim8, wherein the first and second unique identifiers are the same uniqueidentifiers.
 11. A non-transitory computer-readable medium storinginstructions which when executed by a computer in an informationprocessing apparatus cause the computer to perform a method ofcontrolling cameras to assign unique identifiers to frames of capturedvideo, the method comprising: in response to a predetermined triggersignal, send, via a communication interface, a first control signal to afirst camera apparatus that captures a first video, and send, via thecommunication interface, a second control signal to a second cameraapparatus that captures a second video, wherein the first control signalcauses the first camera apparatus to assign a first unique identifier toa frame of the first video that is recorded in a frame buffer of thefirst camera apparatus, the second control signal causes the secondcamera apparatus to assign a second unique identifier to a frame of thesecond video that is recorded in a frame buffer of the second cameraapparatus, the first unique identifier is associated with the secondunique identifier, a first assigned frame in the frame buffer of thefirst camera apparatus corresponds to a timing of reception of the firstcontrol signal, and a first assigned frame in the frame buffer of thesecond camera apparatus corresponds to a timing of reception of thesecond control signal.
 12. The non-transitory computer readable mediumaccording to claim 11, the method further comprising: assigning a thirdunique identifier to a frame of a third video in response to thepredetermined trigger signal, the frame of the third video beingrecorded in a frame buffer of the information processing apparatus,wherein the third unique identifier is associated with the first uniqueidentifier.
 13. The non-transitory computer-readable medium according toclaim 11, wherein a field of view of the first camera apparatus isdifferent from a field of view of the second camera apparatus.
 14. Thenon-transitory computer-readable medium according to claim 11, whereinthe assigned first and second unique identifiers indicate a one-to-onecorrespondence between the frame of the first video and the frame of thesecond video.
 15. The non-transitory computer-readable medium accordingto claim 11, wherein the first and second unique identifiers are thesame unique identifiers.
 16. The non-transitory computer-readable mediumaccording to claim 11, wherein the first control signal causes the firstcamera apparatus to assign the first unique identifier to a first numberof frames of a total number of frames of the first video, the firstnumber of frames being less than the total number of frames of the firstvideo, the second control signal causes the second camera apparatus toassign the second unique identifier to a second number of frames of thesecond video, and the first number of frames is equal to the secondnumber of frames.
 17. The non-transitory computer-readable mediumaccording to claim 11, wherein the first control signal causes the firstcamera apparatus to assign the first unique identifier in a reverseorder of capture, and the second control signal causes the second cameraapparatus to assign the second unique identifier in a reverse order ofcapture.
 18. The non-transitory computer-readable medium according toclaim 17, wherein a field of view of the first camera apparatus isdifferent from a field of view of the second camera apparatus.
 19. Anon-transitory computer-readable medium storing instructions which whenexecuted by a computer cause the computer to perform a method of playingback video recorded by a plurality of cameras, the method comprising:transmitting, via a communication interface, a first unique identifierof a frame of a first video to a first camera apparatus; receiving theframe of the first video in response to the transmitted first uniqueidentifier; outputting the received frame of the first video for displayto a user; in response to a predetermined trigger signal, transmitting,via the communication interface, a second unique identifier of a frameof a second video to a second camera apparatus, the frame of the secondvideo being recorded in a frame buffer of the second camera apparatus,the second unique identifier being associated with the first uniqueidentifier of the frame of the first video, and outputting, from theframe buffer of the second camera apparatus, the received frame of thesecond video for display to the user, wherein the frame corresponding tothe second unique identifier from the second camera apparatus is a firstassigned frame in the frame buffer of the second camera apparatuscorresponding to a timing of reception of the predetermined triggersignal.
 20. The non-transitory computer-readable medium according toclaim 19, wherein the first and second unique identifiers are the sameunique identifiers.